Multi-core Processor Using Virtualization
نویسندگان
چکیده
A Web crawler is an important component of the Web search engine. It demands large amount of hardware resources (CPU and memory) to crawl data from the rapidly growing and changing Web. So that the crawling process should be a continuous process performed from time-to-time to maintain up-to-date crawled data. This paper develops and investigates the performance of a new approach to speed up the crawling process on a multi-core processor through virtualization. In this approach, the multi-core processor is divided into a number of virtual-machines (VMs) that can run in parallel (concurrently) performing different crawling tasks on different data. It presents a description, implementation, and evaluation of a VM-based distributed Web crawler. In order to estimate the speedup factor achieved by the VM-based crawler over a non-virtualization crawler, extensive crawling experiments were carried-out to estimate the crawling times for various numbers of documents. Furthermore, the average crawling rate in documents per unit time is computed, and the effect of the number of VMs on the speedup factor is investigated. For example, on an Intel® CoreTM i5-2300 CPU @2.80 GHz and 8 GB memory, a speedup factor of ~1.48 is achieved when crawling 70000 documents on 3 and 4 VMs.
منابع مشابه
Applying Multi-core and Virtualization to Industrial and Safety-Related Applications
Multi-core and virtualization provide the opportunity to improve device performance, reduce costs through hardware consolidation and upgrade applications more cost effectively throughout the product lifecycle White Paper Disruptive technologies and trends are affecting the embedded market and providing device manufacturers in the industrial sector with a significant opportunity to improve both ...
متن کاملA Qualitative and Quantitative Analysis of Multi-core CPU Power and Performance Impact on Server Virtualization for Enterprise Cloud Data Centers
Cloud is an on demand service provisioning techniques uses virtualization as the underlying technology for managing and improving the utilization of data and computing center resources by server consolidation. Even though virtualization is a software technology, it has the effect of making hardware more important for high consolidation ratio. Performance and energy efficiency is one of the most...
متن کاملI) System Virtualization
Question 1.�� System Virtualization A hot new topic in operating systems is system virtualization. While IBM has been offering its VM system for mainframes for many years, virtualization technologies are now migrating to PC architectures, including PowerPCand i86-based chips. A second trend is the development of multi-core machines, where a single chip essentially implements a small-scale multi...
متن کاملMulticore partitioned systems based on hypervisor
Multi-core processors are increasingly being considered to provide the performance required by future safety critical systems. In some domains like space, it is specially significant due to the processor technology frequency is limited by the presence of radiation. In that case, the way to increase computing power can be achieved by the use of multi-core systems. There is a number of challenges...
متن کامل